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Focusing on research from the mid-1920s to the 
mid-1980s r a study examined the published content analyses of college 
reading texts from the standpoints of methodology employed by various 
writers, specific information presented in respective content 
analy.ses, and observed trends in content presentation that have 
emerged since the mid-1920s. Examination showed that content analyses 
of college reading materials issued before 1975 focused on studies 
analyzing the overall content of a text, and studies analyzing 
specific skills or subskills presented in a text. Contemporary 
content analyses concentrated on the perspectives of 
theory/research-driven analysis and curricular-driven analysis. 
Analysis revealed the following conclusions: (1) a consensus across 
texts as to what constituted effective study methods did not exist; 
(2) research evidence for most of the advocated techniques was 
missing; (3) adequate instruction and practice for presented skills 
and subskills were limited in scope and validity; (4) transfer^ value 
of many practice activities to actual postsecondary reading and study 
tasks was in question; and (5) reliance on impressionistic evidence 
rather than research and statistical evidence was the norm. 
Furthermore, the findings of the early content analyses did not seem 
to influence the authors of contemporary college reading texts. (Two 
tables of data are included, and a master list of college reading and 
learning assistance technical reports and 33 references are 
appended. ) (MM) 
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Abstract 

Content analysis research of instructional materials published for the college 
reading and study-skills market provides a unique view of the educational practices 
driving the field for the past 60 years. Hence, this article examines the published 
content analyses of college reading texts from the vantage of (1) methodology 
employed by various writers, (2) specific information presented in respective 
content analyses, and (3) observed trend' in content that have been presented since 
themid-1920s. 
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the Materials of College Reading Instruction: 

A Critical and Historical Perspective 
From 50 Years of Content Analysis Research 

In reviewing the annual summaries of reading research of the past ten years, one 
observesthat a varied set of investigations falls within the general category of 
document or content analysis. In educational research, the content analysis is an 
objective, systematized examination of a particular document or set of instructional 
materials to determine the quantitative and qualitative characteristics present 
(Borg & Gall, 1983). The process, according to North, Holsti, Zaninovich, and Zinnes 
(1983), involves (1) perusing a representative sample of documents and coding 
information into categories so that frequency counts can be undertaken and (2) 
interpreting t!ie data as it relates to theory, research, and educational practice. 
Reading researchers have tended to scrutinize two broad categories: textual 
factors (readability levels and text formatting) and content factors (subject matter 
units such as main idea instruction and study strategies). According to Best (1977), 
reliable content analysis research not only adds important knowledge to a field, but 
also can be of assistance in evaluating and improving educational practices 

Content analysis can be traced back to the early 1920s (Starch, 1921, Wood, 
1920). Since that time, many content analyses have been directed toward curricular 
materials and basal reading series for primary and middle school reading 
instruction. However, at the postsecondary level, there is a near dearth of content 
analyses research on materials for reading and study-skills instruction, even though 
historical investigations (Stahl, Hynd, &Bro20, 1987) show that more than 500 
college reading and/or study-skills texts have been issued since the 1890s. Five 
distinct categories of texts or workbooks exist: (1) college study-skills texts (Pauk, 
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1984; Sherman, 1984), (2) college reading-skills texts (Brown, 1987; Maker & Lenier, 
1986), (3) speed-readmg texts (Brozo, Schmelzer, & Andrews, 1984; Smith, 1984), (4) 
vocabulary development texts (Levine & Levine, 1980; Shepherd, 1987), and (5) 
college survival texts (Johnson, Springer, & Sternglanz, 1982; Walter & Siebert, 
1984). Additional writers (Heinrichs & LaBranche, 1986; Radencich & Schumm, 
1984) have developed categorization schemes as well. 

With such a diverse set of texts and workbooks available to the college reading 
specialist, one would expect that many researchers would have undertaken 
systematic content analyses of this body of work. This is notthe case. Furthermore, 
- even the limited set of investigations on the topic is not covered in the methods 
texts for the profession ( e. g. , Maxwell, 1979; Trillin & Associates, 1980). 

AS instructional texts for college reading programs continue to proliferate, the 
need for reading specialists to integrate findings from content analysis research 
with the knowledge of how to best teach college reading becomes more critical. 
With a knowledge of this research, college reading specialists can be more 
discriminating in the selection of instructional materials that are based on proven 
research rather than on time-honored, but often questionable, tradition. 

The purpose of this study was to examine the published content analyses of 
college reading texts from the standpoints of (1) methodology employed by various 
writers, (2) specific information presented in respective content analyses, and (3) 
observed trends in content presentation that have emerged across the decades. 
Finally, recommendations for future content analysis research will be set forth. 
Content Analyses of College Reading Materials Issued Before 1 975 
Today's college reading specialists are understandably concerned with the 
materials currently availa' ' - for instruction. Nevertheless, it is important to hold a 
professional world view that incorporates a historical perspective of the field. 
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" Content analyses conduaed in past years allow specialists to examine the concepts 
and materials that shape our current endeavors. Hence the discussion of content 
analysis research pertinent to c Dllege reading and study-skills instruction begins 
with those investigations of materials in press prior to 1975. 

Content analyses holding historical importance can '5e categorized into two 
basic groups: studies analyzing the overall content of a text (Bahe, 1970; Laycock & 
Russell, 1941; Miller, 1957) and studies focusing on specific skills or subskills 
presented in a text (Browning, 1976; Ironside, 1963; Utsey, 1968). 
Full Text Studies 

In the earliest identified content analysis of how-to-study materials, Laycock and 
Russell (1941) reviewed recommendations for successful studying in 38 manuals 
published between 1926 and 1939. An analysisof the 3,473 discussions, examples, 
and exercises in the manuals revealed that the authors of the era emphasized 
reading habits and skills; preparing for and taking examinations; developing good 
habits of learning, outlining, and notetaking; participating in classroom activities; 
memorizing textual materials; using the library; and understanding the physical 
and psychological conditions for studying. Although a number of study activities 
surfaced regularly in the manuals, there was a lack of consensus across texts as to 
what constituted effective study methods. In addition, few of the techniques in the 
manuals were supported by research findings from the period. 

At the time of the expansion of the college reading movement to serve students 
drawn into higher education by the "G.K Bill" after World War II and the Korean 
War, a second content analysis of manuals appeared in the literature. In 1957 Miller 
summarized and evaluated the significant features of 33 college reading workbooks 
and texts, of which 20 books were of re :ent vintage. Miller classified the texts into 
four categories based on textual factors and pioduction factors: pamphlets with 
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limited practice exercises (1 book), expendable workbooks with practice exercises 
(19 books), textbooks with limited exercises (9 books), and paired sets of textbooks 
and workbooks (4 books). 

An analysis of the subject matter in the books showed that word meaning and 
vocabulary development exercises (23 books) were most apt to be included in the 
texts under review. Other categories of exercises in descending order of frequency 
included study or thinking exercises (22 texts), critical or analytical reading exercises 
(18 texts), exploratory or continuous reading exercises (18 texts), skimming or idea 
reading exercises (15 texts), phrase and sentence meaning exercises (8 texts), eye 
span exercises ' -xts), and number and letter recognition exercises (4 texts). In 
examining the length of the reading passages in each book, the investigator found 
most of the texts contained passages of 800 to 2,000 words. 

In the latter 1960s, when the doors of higher education were opening to 
previously under-represented populations, Bahe (1970) analyzed 23 current college 
reading manuals. The writer placed 38 subskills within seven instructional groups 
and then reviewed each manual to determine whether discussions or practice 
activities were presented for each subskill. 

Bahe noted that frequently the reader was informed of what to do but rarely 
was told why or how the skill should be mastered. In addition, research evidence 
supporting the strategies or suggested habits was usually disregarded in favor of 
preachments. Bahe advocated thatfuture authors include ten generally neglected 
subskills: (1) flexibility, (2) retaining hew word meaning, (3) word attack, (4) 
selecting significant details, (5) sequencing, (6) interpreting graphics, (7) syllogistic 
reasoning, (8) analogy patterns, (9) content field study, and (10) interpreting 
figurative language, along with statistical evidence supporting the effectiveness of 
the instructional program forming the foundation for each text. 
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Skill Specif icStu dies 

The content analyses which center on specific skills were generally incorporated 
within a broader discussion on the pedagogical implications of teaching the 
respective skill. Hence, these studies were limited in both scope and breadth of 
texts under review. The three studies that fall into this category of content analysis 
focus on perception and word recognition (Ironside, 1963), vocabulary instruction 
(Utsey, 1968), and underlining and other text study techniques (Browning, 1976). 

Eleven college reading improvement manuals of the 1950s were surveyed by 
Ironside (1963) to ascertain the varying approaches for developing perception and 
word recognition. After summarizing the relevant content of each text. Ironside 
identified seven common perceptual training techniques: (1) quick-recognition 
tasks, (2) analytical procedures in word, recognition, (3) reading for key words, (4) 
rapid phrase reading, (5) skimming, (6) vocabulary items employing context, and (7) 
speed drills to improve perceptual efficiency. Timed and untimed drills with 
numbers, nonsense words, meaningful words, phrases, sentences, paragraphs, and 
articles ranged from single examples to hundreds of items in the various manuals. 
Ironside questioned the transfer value of the activities using the numbers, nonsense 
spellings, or isolated phrases. However, he supported the utilization of perceptual 
and word recognition training when the activities were related to continuous prose. 

In a published speech on several issues pertinent to college vocabulary 
instruction, Utsey (1968) briefly details a limited survey of 52 texts, programmed 
materials, and manuals for learning machines. The observed instructional content 

tended to be conventional, emphasizing the study of antonyms and synonyms, 

J 

denotation and connotation, etymology, word elements, and dictionary and 
glossary entries. Crossword puzzles were often provided for practice activities, and 
study techniques (SQ3R) were regularly advocated for independent skill 
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development. Since the researcher unfortunately failed to list materials under 
review orto provide a frequency count of the observed instructional elements, the 
study does not meet the full criteria for a content analysis. Still, the work does 
provide at least a glimpse of the content employed in college vocabulary programs 
of the era. 

In the only research -oriented content analysis of the early period, Browning 
(1976) reviewed 19 books and one journal article published between 1957 and 1975. 
Although his main thrust was to demonstrate the inclusion or exclusion of 
underlining techniques in study-skills manuals, the end result was a clear picture of 
the study aids advocated widely during the 1 9 years under review. The investigator 
subjectively ranked authors' primary and secondary preferences for five frequently 
advocated procedures of independent text study. A summary of authors' 
preferences shows that most often a recitation, self-testing procedure was 
recommended (1 6 manuals), followed in order by outlining (1 5 manuals), SQ3R style 
systems (13 manuals), underlining (8 manuals), and marginal notes (7 manuals). 
Browning detailed specific issues pertaining to the texts' coverage of the 
underlining study method and reviewed the pertinent research on the topic. He 
concluded that until an effort is made to investigate key research questions, authors 
would continue to rely on anecdote, opinion, and intuition in recommending how, 
when, and whether underlining could serve as a technique for studying. 

Even though the content analysis research from this earlier period is 
unsophisticated by today's standards, it provides us with more than a passing glance 
at texts and workbooks important to the field throughout the first 75 years of 
college reading instruction. Moreover, it gives us an unique perspective of the 
traditions that molded the very foundations, if not the controlling interests, of the 
current materials of instruction. 



Materials of College Reading 

9 

A cursory review of the content identified by these researchers suggests that 
topics presented in years past are indeed the topics covered today. Hence, we pose 
an evaluative, rather than a historical, question: How did the recommendations or 
findings from these past analyses influence either the content factors or the textual 
factors observable in modern texts? On the surface, at least, it appears that the 
modern writers did not heed the relevant content analysis findings, suggesting that 
topics in the early texts had limited support from research and that authors offered 
little more than pedantic recommendations drawn from personal experience and 
considered opinion. 

To answer our question, however, one does not need to rely on subjective 
perusals of current texts alone. The reading specialist can turn to a recent set of 
investigations employing facets of modern content analysis. 

Contemporary Analyses of College Reading Materials 

In the most practical sense, modern content analysis attempts to determine the 
validity of individual texts based on a combination of factors, such as (1) 
existence/soundness of theoretical or research underpinnings, (2) breadth and 
depth of coverage of subject, (3) appropriateness of text to existing orproposed 
instructional goals or educational situations, and (4) value of content to both 
learners and instructors. Hence, validity is a measure of the relation of content tc 
such considerations. If the desire is to evaluate the basic content validity of a 
particular text or a corpus of related texts, the foundations in current theory or 
soundness of supporting research should be weighted more heavily than the other 
factofiK. If, however, the primary concern is directly related to local conditions that 
are controlled by developed programmatic goals or instructional objectives, then 
the latterthfee factors are more important. 
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Each of these two directions for content analysis (i.e., theory/research driven or 
curricular/instructional objective driven) ari of equal importance but tend to be 
employed for different purposes. The contemporary content analyses with college 
reading materials present both perspectives. 
Theorv/Research-Driven Analysis 

In a theory-driven analysis, the researchers cull the professional literature 
extensively to establish a theoretical premise or to accept a previously postulated 
theory or a verified construct. Then the investigators judge whether the content 
factors and textual factors found in individual texts and across the sample of texts 
are supported by the theory/research serving as the benchmark. With regard to 
materials for the college reading program, there are two examples of 
theory/research-driven analysis. 

Stahl, Brozo, and Simpson (1 987) proposed an overall thesis that generative 
approaches to vocabulary instruction weresuperiorto additive approaches when 
promoting independent vocabulary acquisition by college students. This 
proposition was based on extensive reviews of the literature on vocabulary 
instruction (Simpson, 1985). With such a premise to guide the analysis, the writers 
systematically classified and tabulated the units of content within each of the 55 
books. Then the reviewers evaluated the data to determine whether generative or 
additive approaches to vocabulary instruction were employed by the author/s of 
each text. With this procedure, a measure of validity for both content classifications 
and extant texts was put forth, and in most instances materials were found to be 
less than acceptable, given the overall postulate guiding the analysis. Even when 
generative categories of instruction were present, the potential of such strategies 
was lost because of irrelevant or invalid exercises. Furthermore, the findings, 
summarized in Table 1, pointoutthat vocabulary texts for postsecondary reading 
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populations have not tapped the full promise of generative instruction for 
independent vocabulary mastery. 



Insert Table 1 about here 



A second but somewhat different theory/research-driven content analysis of 
college reading materials was issued by Brozo and Johns (1986). These writers 
focused on content in 40 speed-reading texts. Particular concern was given to 
discovering the relationship between acceptable research and three content 
factors: eye movements, span of recognition, and rates of reading. Unlike the 
previously discussed analysis by Stahl, Brozo, and Simpson (1 987), which utilized 
research to substantiate a broad-based premise for evaluating vocabulary texts, 
Brozo and Johns attempted to evaluate the three content factors in light of specific 
research related to each factor. For instance, 16 authors suggested that students 
using recommended techniques could achieve extremely rapid rates of reading at or 
above 1,000 words per minute, while other authors (12 books) stated that rates up 
to 1,000 words per minute were feasible. The researchers pointed out that 
numerous investigations suggest the upper limits of actual reading rates are well 
below the level of 1 ,000 words per minute and such a rate is actually akin to 
skimming materials. Additional findings, summarized in Table 1, show that when 
authors of speed-reading texts covertopics pertaining to eye movements and/or 
span of recognition, they rarely offer content derived from acceptable research. 

When writers of any unit-by-unit, research-driven content analyses offer 
recommenddfichs, thty must limit responses to the strengths and weaknesses of the 
specifier --itfactors under review. Hence, the readers of such reports must be 
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careful to view the finding within the delimitations set forth by the researchers. For 
instance, Brozo and Johns (1986) suggested that authors of speed-reading books 
should reconsiderthe inclusion of several of the regularly recommended methods 
for increasing reading rate. The readers of such research, however, are left to judge 
for themselves how questionable content units might influence the overall validity 
of each speed-reading text. 

Of course, the validity of either of these analyses (Brozo & Johns, 1 986; Stahl, 
Brozo, & Simpson, 1987) holds only as long asthetheory is judged to be sound or 
the interpretations of the research are accurate. As new evidence is obtained, or as 
new paradigms are introduced, texts in various content areas should be 
reevaluated. The data should then be used in future texts or revisions of current 
editions to update/upgrade the materials. 
Curricular-Driven Analysis 

Another reason to conduct a content analysis of reading materials is to 
substantiate a curricular model or instructional orientation. Unlike the theory- 
driven orthe research-driven approaches, which are primarily concerned with the 
basic validity of the content of the various texts, the curriculum-driven approach 
identified texts or units within the texts that support the local programmatic 
philosophy and the associated instructional goals. Usually the goals and the 
objectives have been conceptualized previously by the faculty, organized in a course 
description or a syllabus, and accepted by the appropriate institutional committees. 
Hence, the standard outcome is not to redesign texts or textual units, but rather to 
form a match between available materials and the instructional program. 

In an example of a curricular-driven content analysis, Huinrichs and LaBranche 
(1986) analyzed 47 textbooks, published for the most part between 1982 and 1985. 
The team of five evaluators developed a set of criteria based primarily on the 
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observed characteristics of their students and on the short- and long-term academic 
needs of students traditionally enrolled in the reading program. Although 
supplemental support for the criteria was drawn from the literature, the overall 
analysis was driven by the curricular goals and objectives of an existing 
learning/study-skills course. The procedure for analysis was concerned primarily 
with the identification and frequency of units of content as well as organizational 
factors corresponding to the stated criteria. Upon completion of this process, the 
data from the analysis (e.g., page counts and qualitative rankings) provided the 
evaluatorswith a bird's-eye view of the content of 47 texts across five subject areas 
as related to their program. From this information, the authors observed that none 
of the texts was all inclusive of the course goals and objectives. Hence, they decided 
to use a multiplicity of materials in support of the course instruction. 

One more contemporary study which can be best described as a curricular-driven 
content analysis is the work by Radencich and Sch umm (1 984). In this analysis of a 
limited number of books drawn from four subject matter categories,.the authors 
used reported research, related literature, and judgmental statements to develop a 
list of content factors and textual factors which should be included in texts. Next 
the writers subjectively rated each book as to its presentation of each factor. 
Finally, the authors put forth a list of generalized statements about the content of 
materials on the market and, like Heinrichs and LaBranche (1986), these authors 
recommended that instructors adopt texts from two categories (reading instruction 
and college survival instruction). 

The results of this analysis employ some of the characteristics of research-drivon 
studies. However, since the corpus of texts was limited in number, support for 
content factors and text factors rested heavily on judgment rather than research. 
Thus, evaluations/conclusions were more applicable to the text selection process at 
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the local level, and the analysis serves pragmatically as a curricular-driven content 
analysis. 

These examples demonstrate that the underlying strength of this approach is 
that it provides data which is usable at the local level. On the other hand, its 
inherent weakness is that the programmatic goals and instructional objectives of 
the program or course might rest upon a foundation of research, instructional 
practices, or traditional content that is outdated, ill-conceived, or of questionable 
merit The actual value of any curricular-driven content analysis is only as valid as 
the basictheoretical or research foundation upon which the college reading 
curriculum rests. In some instances, the individuals undertaking such a process 
might better reevaluate the concepts and principles underlying program goals and 
objectives. Such action could then be followed by a curricular-driven content 
analysis. 

Lessons Learned and Future Directions 
Through this review of content analysis research of college reading materials, we 
are able to discover the subject matter covered in the many texts under review. We 
also note that the evolving analysis process is becoming more sophisticated from 
the standpoints of type of analysis, content under analysis, and data provided in the 
study (refer to Table 2). Yet, the discussion of the issues covered here has been 



Insert Table 2 about here 

based on a form of secondary research-i.e., we have drawn our information from 
analyses published across several eras. Such a process limits the nature of the 
generalizations that can be raised, given the information or data provided by the 
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primary authors. The problem is further compounded when findings are integrated 
with our interpretations of the principles and theories guiding postsecondary 
reading instruction in the latter 1980s. 

Nevertheless, when the conclusions of the varied authors are taken in total and 
across the years, five generalizations regularly surface: (1) a consensus across texts 
as to what constituted effective study methods did not exist, (2) research evidence 
for most of the advocated techniques was missing, (3) adequate instruction and 
practice for presented skills and subskills were limited in scope and validity, (4) 
transfer val ue of many practice activities to actual postsecondary reading and study 
tasks was in question, and (5) reliance on impressionistic evidence rather than 
research and statistical evidence was the norm. Furthermore, it does not appear 
that the findings of the early content analyses have influenced those individuals 
who are currently authoring texts. In fact, a comparison of the data from the 
content analyses of past eras with the contemporary studies might lead to the 
accusation that the field of college reading is overly dependent upon a curriculum 
of tradition as opposed to a curriculum driven by current applied research and/or 
theory. Although such a conclusion is indeed open to debate, a comparison of the 
findings from the Ironside analysis (1963) with the Brozo and Johns study (1986), as 
well as a comparison of the Utsey work (1968) with the more recent analysis by 
Stahl, Brozo, and Simpson (1987), demonstrate that over the years texts have 
retained content factors of questionable value. On the other hand, textual factors 
(e.g., advance organizers) and content factors (e.g., metacomprehension) began to 
appear in texts as they gained a combination of pedagogical validity and 
professional trendiness. Hence, it appears that new content does find its way into 
texts, but often more traditional factors, even of questionable worth, are 
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maintained. Perhaps the inclusion or the exclusion of content is as much a product 
of market research as educational research. 

; Although a numberof content analyses have been undertaken in recent years, 

more research is needed. Authors of the content analyses (particu larly those issued 
before 1984) tended to direct their investigations toward the frequency of specific 
subject matter and also the inclusion of factors that promoted or hindered the 

^ presentation of the content (e.g., readability, graphic presentations, teacher's 

guides). We need to return to the primary sources to determine how the many 
authors presented or taught the content (topics) to the students across generations 
* of textbooks. Through such cross-generational content analysis, the field can come 

: ' to understand the unique interaction of tradition with modern thought in the 

authoring/marketincj of texts for college reading instruction. For instance, it is 
evidentthatseveral subject areas or skills (outlining, notetaking) have been 
included in texts across the years. We may discover that the sheer power of 
tradition in college reading is of such force that content and instructional 
presentation remainsstatic through the succeeding generations of texts. On the 
other hand, recent pedagogical understanding, may have led to more effective 
presentation of various concepts, methods, or techniques. Hence, we may discover 
that while content remained somewhat static, instructional method has evolved 
along with changing theory, recent research, and even regularly occurring fads. 
Furthermore, with such work the specialist can glimpse into the evolution of a field 
and learn of the methods seemingly lost to the years (e.g., the three-level outline 
method, the self-recitation study method). 

A second avenue of future research should be category specific and directed 
tov^ard texts currently on the market. Content analyses driven by theory or research 

: have been undertaken with an extensive numberof recent texts drawn from 
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adjunct categories of college reading materials (i.e., vocabulary texts and speed- 
reading texts); On the other hand, recent works by Heinrichs and LaBranche (1986) 
and Radencich and Schumm (1984) analyzed texts across several categories, so 
neither study can be viewed as in-depth analyses of books from any particular 
category. Hence, we believe that researchers need to undertake in-depth 
theory/research-driven analyses of college study-skills texts, college>eading-skills 
texts, and college survival texts, in addition, reviewers should look carefully at the 
pedagogical recommendations contained in the instructors' manuals accompanying 
many texts on the market. Finally, in-depth analyses need to be undertaken with 
computer software that appears appropriate to the postsecondary reading 
program. Such software can be utilized by instructors as the primary vehicle of 
instruction or as supplementary aids. Hence, researchers would need to view the 
content from the perspective of theory and research as well as the corresponding 
subject matter in the respective corpus of published texts. 

Afinal direction forfuture research should be to utilize various forms of 
integrative research review (e.g., critical analysis, meta analysis) with content 
analysis to investigate trie validity of specific content factors. As an example, a 
researcher might undertake a content analysis of college study-skills texts to 
ascertain how current texts evaluate readinessfornotetaking, teach the role and 
value of notetaking, and present strategies for notetaking. Then, using the findings 
presented in the critical analyses (e.g.. Hartley & Davies, 1978; Rickards, 1979) and 
the neta analysis (Henk & Stahl, 1 985), a set of acceptable research-supported 
criteria is ordered in a coding system. As the next step, the texts in a particular 
category would be evaluated using the system. The work of Browning (1975) with 
underlining and, to a lesser degree, that of Brozo and Johns (1 986) with rate 
development, approach this style of analysis. Whenever critical analysis or meta 
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analysis reviews have not beea undertaken for a particular topic, the content 
analysis will by necessity include an exhaustive, in-depth review of the literature. 

A word of caution must be noted for those considering the conduct of a content 
analysis with college reading materials. Researchers who undertake content 
analysis with current texts and especially with out-of-print texts must be careful to 
study a corpus of materials that accurately represents all of the primary texts for 
each subject category and for each era under review. A mere sampling of 
documents may identify readily accepted content factors or textual factors, but the 
sampling itself may overlook texts which contain "experimental" or innovative 
" factors that signal new emerging trends in postsecondary reading instruction. 
Hence, we recommend that writers strictly delimit the breadth of the content 
analysis to a particular category or subcategory of text. They should then strive to 
review as many texts as can be obtained, using personal libraries, institutional 
libraries, interlibrary loan, and the good v^^ill of publishers and colleagues. 
Hopefully, some day the sampling problem will be obviated, as the field of 
postsecondary reading will have a national repository of curricular materials 
(perhaps the Stauffer LibraVy at I.R.A. headquarters or any of the textbook 
collections at Hofstra University, Trinity College, Northern Illinois University, 
Columbia University, or the University of Pittsburgh) that can lend materials to 
researchers undertaking content analysis research. 
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Tabic I 

Content Analyses with Contemporary Postsecondary Reading Materials 



Researcher/s 


Content Analyses 
Procedures 


Text Category and 
Number of Texts 


Text Factors and 
Content Factors 


Findings and Kcccimmcndatioas 


Radencich & 
Schumm 
(198A) 


Analysis - 
Curricular Driven: 

Analysis based on 
limited research 
and judgmental 
validity supporting 
content factors. 


Four categories of texts 
published between 1976 
and 1983. (n-17) 

1) College surfvival 
texts (n«4) 

2) College reading 
instruction texts 
(n-4) 

3) College survival and 
reading Instruction 
texts (n«5) 

4) College reading 
practice texts (n«A) 


The number and nature of the 
text factors and the content 
factors differed according to 
the purpose of the text. For 
instance, college survival 
texts were analyzed for 11 
text factors and 17 content 
factors. 

The writers utilized a four- 
point rating (i.e., 1) no 
inclusion, 2) fair coverage, 
3) good coverage, and A) 
excellent coverage) to 
evaluate text factors and 
content factors. 

A readability level for each text 
is provided. 


Elements common to most texts include 
advance organizers, use of subheadings 
and lists, provision of learning 
strategies, and instruction of pre- 
viewing, main ideas, and paragraph 
organization. 

Few texts include review questions, 

instruction on self-appraisal, spelling, 
non-textbook reading, writing, critical 
reading, or content specific instruction. 

Supplementary reading selections in texts 
tended to be of a broad range of read- 
ability levels and passages tended not 
to be organized in a progression of 
levels. 

Teacher*s guides were not offered 
routinely. 

The lack of instruction in college reading 
practice texts make them the least 
useful. Instructors should assign a 
college survival text and a college 
reading instruction text. 
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> Table 1 

f Content Analyses with Contemporary Postsecondary Reading Materials (continued) 



<;Re8earcher/8 


Content Analyses 
Procedures 


Text Category and 
Number of Texts 


Text Factors and 
Contcr.c Factors 


Findings and Reconnendacions 


Heinrichs & 
LaBranche 
(1986) 


Analysis - 
Curricular Driven: 

Analysis based 
primarily on the 
objectives and goals 
of local conditions. 


Five categories of texts 
issued since 1981. 
(n-A7) 

1) Reading skills texts 
(n-lA) 

2) Learning skills texts 
(n-6) 

3) Combined reading and 
utudy skills texts 
(n-13) 

4) Speciality texts 
(n-6) 

5) Resource or supplementary 
cexus vn^o^ 


Organizational factors included 
reading passages, instructor's 
manuals, answers in student texts, 
index, glossary, and overall 
quality. 

Content factors included vocabulary, 
main ideas and details, reading 
speed, reading comprehension, 
critical reading, organizational 
patterns, notetaking, study 
systems, memory, test taking, 
content areas, reasoning/problem 
solving, graphics, and library/ 
dictionary skills . 

For each of the texts, the writers 
note 

1) the number of pages devoted to 
each content factor 

2) the presence of various 
organizational factors 

3) the overall qualitative 
ranking. 


Examination of texts revealed little 
variation with regard to format. 

Newer texts (since 1982) present core 
content area-specific material, 
techniques of test-taking skills, 
memory aids and procedures, and 
instructor's manuals. Tney devote 
whole chapters to direct instructions 
in patterns of organization of cext. 
Reading speed is related to purpose 
of reading, rather than as a skill 
isolated from meaning and purpose. 
Meta-cognitive awareness is often 
covered. 

Very few textbooks are all inclusive; 
hence, authors decided to use core 
than one cext in their program. 
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Table 1 

Content Analyses with Contemporary Post secondary Reading Materials (continued) 



Researcher/ s 


Content Analyses 
Procedures 


Text Category and 
Number of Texts 


Text Factors and 
Content Factors 


Findings and Recommendations 


Stahl, Brozo 
& Simpson 
(in press) 


Evaluation - 
Theory Driven: 

Generative methods 
of vocabulary 
instruction are 
superior to 
additive methods 
when teaching 
students to 
independently 
develop word 
knowledge in 
college. 


Vocabulary development 
texts currently in 
print. (n=55) 


Thirteen instructional categories 
were observed, and three cate- 
gories were noted as generative 
in nature (word elements, 
dic'cionary/ref erence sources, and 
context clues) while ten 
categories were said to be 
additive instruction 
(pronunciation, confused/ 
misused words, related words, 
historical contexts, foreign 
words, descriptive words, figures 
of speech, content field, proper 
nouns, synonym/antonym) . ' 


The generative potential of the three 
generative strategies was lost to 
irrelevant or invalid exercises. 

When all the texts were categorized in 
total« AS were found to have an additive 
philosophy, three were of a generative 
philosophy bnt treated presencations in 
an additive manner, and seven texts had 
a mixed philosophy. 

Materials should encourage students to 
independently develop their vocabu- 
laries. 

Materials should stimulate students* 
deeper levels of understanding about 
each word of study. 

Materials should teach contextual 
analysis with actual texts. 

Materials which emphasize the r.astery 
list or additive approach to 
vocabulary development should cognize 
words in semantically-related sets. 

Materials should incorporate nnczionic 
devices and rehearsal guidelines to 
promote long-term vocabulary learning. 

Textbook authors should carefully 
scrutinize the validity of each 
exercise format. 




Table 1 

Content Analyses with Contemporary Postsecondary Reading Materials (continued) 



Rescarcher/s 


Content Analyses 
Procedures 


Text Category and 
Number of Texts 


Text Factors and 
Content Factors 


1 
1 
• 

Findings and Recommendations j 

i 


Brozo & Johns 
(1986) 


Evaluation - 
Research Driven: 

Results of analysis 
were compared wich 
recent empirical 
findings on span of 
recognition, 
regressions, and 
rates of reading. 


Speed reading texts 
issued since 1950. 


Text factors included elements 

related to layout (e.g., glossary, 
preiace, pobxtion oi assessmenc 
chec ks , s t a t ed ob j ec t ives , and 
theoretical foundations of the 
book) . 

Content factors included elements 
on methods and techniques to 
increase reading speed (e.g., 
instruction in using pen or 
finger as pacer, increasing span 
of recognition, discussion of 
subvocalization) * 


Authors of speed reading texts should | 
reconsider some of their methods* | 
Practice exercises in reading entire j 
lines or blocks of print should be 
eliminated from future books. 
Readers muat recognize that claims of { 
1,000 w.p.m. rates are of question. 
Some speed reading texts seem to treat I 
poor eye movements as the cause of 
slow, inefficient reading and suggest 
that by eliminating eye regressions 
and increasing span of recognition 
that reading ;ibility will improve. 








Particular concern directed at 
content related to eye movements, 
including span of recognition, 
and the upper rates attainable 
through practice. 


Considerable work must be done to bring 
practices in line with current 








research understandings. 
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Table 2 

Summary of Analysis Procedures 





Authors* 
Description 
of Texts 


Number of 
Texts 


Range of 
Copyright Dates 


Text Categories 
and Number 


Type of 
Analysis 


Content 
Analyzed 


Data 
Provided 


Laycock & 
?.ussell 
(1941) 


How to study 
manuals 


38 


1926-1939 


Not categorized 


Curricular 
driven 


Content factors 


Frequency counts 
Instructional 
discussion 


Miller 
(1957) 


College reading 
workbooks 


33 


1928-1956 


Pamphlet (1) 
Workbooks (19) 
Textbooks (9) 
Paired Sets (4) 


Curricular 
driven 


Content factors 
Textual factors 


Frequency counts 
Individual 

descriptions 
Instructional 

discussion 
Book list 


Ironside 
(1963) 


College reading 

improvement 

manuals 


11 


1943-1961 


Not categorized 


Curricular 
driven 


Content factors 
(perception and 
word recognition) 


Individual 

descriptions 
Research discussion 
Instructional 

discussion 
Book list 


Utsey 
(1968) 


Vocabulary 

development 

materials 


52 


Not stated 


Commercial workbooks 
Texts 

Machine systems 
Programmed 

materials 
Nonpublished 

materials 


Curricular 
driven 


Content factors 
(vocabulary) 


Instructional 
discussion 
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Table 2 

Sumroary of Analysts Procedures (continued) 





Authors* 
Description 
of Texts 


Number of 
Texts 


Range of 
Copyright Dates 


Text Categories 
and Number 


Type of 
Analysis 


Content 
Analyzed 


Data 
Provided 


Bahe (1970) 


Comprehensive 
college reading 
manuals 


23 


1961-1969 


Considered "multi- 
purpose publications'' 


Curricular 
dr iven 


Content factors 
Textual factors 


Individual 

descr ipt ions 
Instructional 

discussion 
Book list 


Browning 
(1976) 


How to study 
manuals 


19 


' 1957-1975 


Not categorized 


Research 
driven 


Content factors 
(study aids) 


Indiv idual 

descriptions 
Research discussion 
Book list 


Radencich & 
Schumm 
(198A) 


Reading/study 
skills textbooks 


17 


1976-1983 


College survival 

texts (A) 
College reading 

instruction 

texts (A) 
College survival/ 

reading 

instruction 

texts (5) 
College reading 

practice 

texts (A) 


Curricular 
driven 


Content factors 
Textual factors 


Subjective ratings 
Individual 

descriptions 
tveseaLcn uxo^uooxuii 
Instructional 

discussion 
Book list 
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Table 2 

Suwnary of Analysis Procedures (continued) 





Authors * 
Description 
of Texts 


Number of 
Texts 


Range of 
Copyright Dates 


Text Categories 
and Number 


Type of 
Analysis 


Content 
Analyzed 


• 

Data 
Provided 


Heinricns o 
LaBranche 
(1986) 


College learning 
skills textbooks 


A7 




Reading skills 

texts (lA) 
Learning skills 

texts (6) 
Reading and study 

texts (A) 
Speciality texts 

(6) 

Resource or 
supplementary 
texts (8) 


Curr icular 
driven 


Content factors 
Textual factors 


Subjective ratings 
Frequency counts 
Individual 

descriptions 
Instructional 

discussion 
Book list 


Brozo & 
Johnc 
(1986) 


Speed reading 
books 


AO 


1958-1985 


Not categorized 


Research 
driven 


Content factors 
(eye movements* 
recognition span, 
regressions, 
reading rates) 
Textual factor^ 


Frequency counts 

(AFA)* 
Research discussion 


Stahl» 
Brozo, 
& 

Simpson 
(in press) 


Post secondary 

vocabulary 

books 


55 


1939-1985 


Workbooks (33) 
Textbooks (3) 
Popular press/ 

trade books (11) 
Programmed 

instruction (8) 


Theory 
driven 


Content, factors 


Frequency counts 
Individual 

descriptions 

(AFA)* 
Theoretical 

discussion 
Research discussion 
Instructional 

discussion 



^Available from 

* authors 
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College Reading and Learning Assistance Technical Reports 



Technical 
Report No, 

84-01 Brozo, W.B. , Schmelzer, R,V., & Spires, N.A. A Study of Test 
Wiseness Clues in College/University Teacher-Made Tests with 
Implications for Academic Assistance Centers. (ERIC No. ED 
240-928) 

84-02 Stahl, N.A., Brozo, & Henk, W.A, Evaluative Criteria 

for College Reading-Study Research. (ERIC No. ED 240-933) 
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for rfiting Competencies of College Reading Specialists. 
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84-05 Stahl/ N.A., Brozo, W.G., & Gordon, B, The Professional 

Preparation of College Reading and Study Skills Specialists. 
(ERIC No. ED 248-761) 

84-06 Stahl/ N.A. & Brozo, W.G. Vocabulary Instruction in Georgians 
Post^-secondary Reading Programs. (ERIC No. ED 248-759) 

84-07 King^ J*R./ Stahl, N.A., & Brozo, W.G, Integrating Study 
Skills and Orientation Courses. (ERIC No. ED 248-760) 

8 4-0 8 Brozo, W.G. & Schmelzer, R.V. Faculty Perceptions of Student 
Behaviors: A Comparison of Two Universities. (Not Submitted 
to ERIC — See the Journal of College Student Pe rsonnel/ Vol. 
26, #3) 

84-09 Henk, W.A., Stahl, N.A., & King, J.R. The Readability of 

State Drivers' Manual. (Not submitted to ERIC — please refer 
to Transportation Quarterly , 2.^(4) , 507-520) . 

84- 10 Stahl, N.A., Henk, W.A., & King, J.R. Are Drivers' Manuals 

Right for Reluctant Readers? (ERIC No. ED 245-208) 

85- 01 Stahl, N.A., Hynd, C.R., & Henk, W.A. Avenues for Chronicling 

and Researching the History of College Reading and Study 
Skills Instruction. (ERIC No. ED 256-245) 

85-02 Smith, B.D. fk Elifson, J.M. Do Pictures Make a Difference in 
College Textbooks? (ERIC No. ED 256-246) 
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Brozo^ W.G.r Stahl, N.A.^ & Gordon^ B. Training Effects of 
Sununarizing^ Item Writing^ and Knowledge of Sources on 
Reading Test Performance. (ERIC No. ED 256-247) 

Brozo^ W.G. Teaching Students to Recognize and Manipulate 
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